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Preface 


At  the  ee"’  Meeting  of  the  AGARD  Structures  and  Materials  Panel,  held  in  1988  in  Luxembourg,  a  workshop  was  held  on 
Nondestructive  Evaluation  (AGARD  Report  768).  This  was  the  first  of  four  workshops  organized  by  the  SMP  on  Damage 
Tolerance  For  Engine  Structures.  A  paper  was  presented  at  that  workshop  by  staff  of  the  NRC  Institute  for  Aerospace  Research 
on  "Importance  of  the  Sensitivity  and  Reliability  of  NDI  Techniques  on  Damage  Tolerance  Based  Life  Prediction  of  Turbine  Discs" 
[1].  This  paper  presented  the  results  of  a  demonstration  project  designed  to  establish  the  reliability  and  sensitivity  of  the  non¬ 
destructive  inspection  methods  commonly  used  by  engine  maintenance  organizations  in  Canada  to  inspect  gas  turbine  engine 
compressor  discs.  The  results  were  surprisingly  poor,  and  showed  that  the  methods  then  employed  were  not  able  to  support  damage 
tolerance  based  life  management  of  these  components  in  a  manner  consistent  with  the  stringent  requirements  laid  down  by  MIL 
Standard  1783.  Interestingly,  this  was  one  of  the  first,  and  possibly  the  first  rigorous  demonstrator  project  performed  using  real 
service  exposed  components  containing  service  induced  cracks.  In  contrast,  many  of  the  demonstrator  projects  performed  to 
establish  compliance  with  MIL-STD-1783  have  been  performed  using  laboratory  prepared  coupons  containing  laboratory  induced 
cracks. 

Several  of  the  national  representatives  attending  this  1988  workshop  expressed  interest  in  taking  part  in  a  similar 
demonstrator  project  so  as  to  establish  the  reliability  and  sensitivity  of  the  NDI  methods  available  in  their  own  countries.  With 
the  encouragement  of  the  Structures  and  Materials  Panel  of  AGARD,  a  second  demonstrator  project  was  organized.  The  results 
of  this  demonstrator  project  are  presented  in  the  following  report.  Clearly,  the  work  has  been  especially  useful  to  the  laboratories 
that  participated  in  the  project  since  it  has  allowed  them  to  compare  and  contrast  their  own  results  with  those  obtained  in  other 
laboratories  and  hence  calibrate  their  own  capabilities.  In  Canada  it  has  provided  some  impetus  to  the  development  of  fully 
automated  eddy  current  systems  with  powerful  signal  processing  and  pattern  recognition  capabilities,  but  even  these  are  being  found 
to  have  unexpected  limitations,  and  they  need  to  be  used  with  caution.  These  matters  may  be  the  subject  of  future  AGARD-SMP 
reports.  Apart  from  these  direct  benefits  to  the  participating  laboratories,  the  work  has  produced  a  substantial  data  base  on  the 
probability  of  detection  of  flaws  in  engine  component  inspection,  and  this  data  will  be  made  available  to  the  international 
community  through  the  USAF  supported  Nondestructive  Testing  Information  Analysis  Center  (NTIAC)  of  Austin,  Texas,  where 
it  may  be  accessed  electronically. 

The  work  described  in  this  report  was  performed  on  behalf  of  the  Structures  and  Materials  Panel  of  AGARD  and  with 
generous  financial  support  provided  by  AGARD  under  the  R&D  Cooperation  Program.  This  financial  support  allowed  research 
staff  of  the  four  participating  nations  to  make  short  working  visits  to  the  laboratories  of  the  other  countries. 

The  work  carried  out  within  each  country  has  been  performed  with  the  help  of  many  people  who  are  not  identified 
individually,  but  who  are  nevertheless  most  sincerely  thanked.  The  work  has  also  been  supported  by  national  authorities  of  each 
country  who  are  acknowledged  with  gratitude.  The  following  organizations  of  each  country  deserve  special  thanks. 

Canada:  Institute  for  Aerospace  Research  of  the  National  Research  Council  of  Canada,  through  lAR  Program  3H3,  Project  JHUOO. 
The  Chief  of  Research  and  Development  and  the  Directorate  of  Aeronautical  Support  Engineering,  Department  of  National  Defence. 

Greece:  Technology  Research  Center  of  Hellenic  Air  Force.  Hellenic  Aerospace  Industry. 

Turkey:  The  Welding  and  NDI  Centre,  Middle  East  Technical  University.  Lufthansa  Airlines  Maintenance  Facilities,  Hamburg. 
Portugal:  Air  Force  Academy,  Portuguese  Air  Force. 


W.  Wallace 

Director,  Structures,  Materials  and 

Propulsion  Laboratory 

NRC  Institute  for  Aerospace  Research 
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Preface 


On  a  pu  assister,  lors  de  la  66‘  reunion  de  la  Commission  des  structures  et  des  matdriaux  de  I'AGARD  (Rapport  de 
I'AGARD,  n°  768),  en  1988,  au  Luxembourg,  k  la  tenue  d'un  atelier  sur  I'inspection  non  destructive  (IND).  II  s'agissait  du  premier 
des  quatre  ateliers  organises  sur  la  tolerance  au  dommage  par  cette  commission.  Des  repr^sentants  de  I'lnstitut  de  recherche 
adrospatiale  du  CNRC  ont  pu  k  cette  occasion  presenter  une  communication  sur  "I'importance  de  la  sensibility  et  de  la  fiabilitd 
des  techniques  d'inspection  non  destructive  dans  les  mythodes  de  calcul  de  durye  de  vie  des  disques  de  turbine  fondyes  sur  la 
toiyrance  au  dommage  (1)".  La  communication  en  question  prdsentait  le  rdsultat  d'un  projet  de  dymonstration  visant  k  ytablir  la 
fiability  et  la  sensibility  des  rndthodes  d'inspection  non  destructive  utilisdes  au  Canada  par  les  ateliers  d'entretien  des  moteurs  pour 
inspecter  les  disques  de  compresseur.  Ces  rysultats,  ytonnamment  dycevants,  dymontraient  clairement  que  les  mythodes  utilisdes 
n'ytaient  pas  k  mSme  de  rypondre  aux  exigences  rigoureuses  des  normes  MIL-STD-1783  pour  la  gestion  du  cycle  de  vie  des 
composants.  Fait  k  noter,  il  s'agissait  de  I'un  des  premiers  projets,  et  peut-etre  du  premier  projet  de  dymonstration  effectuye  de 
fagon  rigoureuse,  faisant  appel  k  de  vrais  composants  de  turbine  prysentant  des  fissures  survenues  en  cours  de  service.  Dans 
plusieurs  projets  visant  k  dymontrer  la  conformity  aux  normes  MIL-STD-1783,  on  a  utilisy  par  comparaison  des  ychantillons 
pryparys  en  laboratoire  et  contenant  des  fissures  artificielles  ygalement  produites  en  laboratoire. 

Plusieurs  reprysentants  nationaux  ay  ant  assisty  k  I'atelier  exprimkrent  par  la  suite  le  ddsir  de  participer  k  un  projet  de 
dymonstration  similaire  qui  permettrait  d'ytablir  la  liability  et  la  sensibility  des  rndthodes  d'IND  utilisyes  dans  leurs  pays  respectifs. 
Un  second  projet  fut  done  mis  sur  pied  sous  I'ygide  de  la  Commission  des  structures  et  des  matyriaux.  Les  rysultats  qu'il  a  permis 
d'obtenir  sont  prysentks  dans  le  rapport  qui  suit.  Les  travaux  exycutys  ont  yty  particuli&rement  utiles  aux  laboratoires  participants 
du  fait  qu'ils  leur  ont  permis  de  comparer  et  de  contraster  les  rdsultats  avec  ceux  obtenus  par  les  autres  laboratoires  et,  ainsi, 
d'ytalonner  leurs  techniques.  Au  Canada,  le  projet  a  encouragy  la  mise  au  point  de  systkmes  d'inspection  k  courants  de  Foucault 
entikrement  automatisys  avec  fonctions  de  traitement  de  signal  et  de  reconnaissance  de  spectre,  mais  dont  les  capacirds  ont  rdvdiy 
des  limites  inattendues,  ce  qui  oblige  k  les  utiliser  avec  prudence.  Ce  domaine  pourrait  donner  lieu  k  de  futurs  rapports  de  la 
Commission  des  structures  et  des  matyriaux  de  I'AGARD.  En  plus  de  ces  avantages  directs  dont  ont  bynyficid  les  participants, 
les  travaux  ont  produit  une  banque  de  donnyes  substantielle  sur  la  probability  de  la  dytection  des  dyfauts  lors  de  I'inspection  des 
composants  de  moteurs  et  ces  donnyes  seront  mises  k  la  disposition  de  la  communautd  Internationale  par  I'entremise  du  Non 
destructive  Testing  Information  Analysis  Centre  (NTIAC)  parraind  par  I'USAF  et  situd  k  Austin,  Texas,  oil  les  doandes  seront 
accessibles  dlectroniquement. 

Les  travaux  dderits  dans  ce  rapport  ont  dtd  entrepris  au  nom  de  la  Commission  des  structures  et  des  matyriaux  de  I'AGARD 
grace  k  un  apport  financier  gdndreux  de  I'AGARD  dans  le  cadre  du  Programme  de  coopdration  en  R  et  D.  Cette  aide  financiere 
a  permis  k  plusieurs  chercheurs  de  chacun  des  quatre  pays  participants  d'effectuer  de  courtes  visites  de  travail  dans  les  laboratoires 
des  autres  pays  affilids. 

Les  travaux  entrepris  dans  chaque  pays  ont  fait  appel  k  la  participation  d'un  grand  nombre  de  personnes  dont  le  nom  n'est 
pas  mentionnd  individuellement  mais  que  Ton  remercie  toutefois  trks  sinc6rement.  Les  travaux  ont  dgalement  dtd  finaneds  par  les 
autoritds  nationales  de  chacun  des  pays  participants  qui  ont  toute  notre  reconnaissance.  Nous  tenons,  enfin,  k  remercier  tout 
spdcialement  les  organismes  suivants  : 

Canada  :  I'lnstitut  de  recherche  adrospatiale  (IRA)  du  Conseil  national  de  recherches  du  Canada  (CNRC),  dans  le  cadre  du 

Programme  3H3,  Projet  JHUOO,  de  I'IRA;  le  chef  de  la  recherche  et  du  ddveloppement  et  le  directeur  technique 
du  soutien  adrospatial  du  ministkre  de  la  Ddfense  nationale 

Grkce  ;  le  Centre  de  recherche  en  technologie  de  rArmde  de  I'air  grecque 

Turquie  :  le  Centre  de  soudure  et  d'inspection  non  destructive  de  I'University  technique  du  Moyen-Orient;  les  ateliers 

d'entretien  de  la  Lufthansa,  Hambourg 

Portugal  :  I'Acadymie  de  I'Armye  de  fair  du  Portugal 


W.  Wallace 
Directeur 

Laboratoire  des  structures,  des  matyriaux  et  de  la  propulsion 
Institut  de  recherche  ayrospatiale  du  CNRC 
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SUMMARY 

Under  the  auspices  of  the  AGARD  Structures  and  Materials  Panel  R&D  Cooperation  Program,  a  round-robin  NDI  demonstration  has 
been  carried  out,  Six  laboratories  in  four  NATO  countries  participated  in  the  project.  The  aim  of  the  project  was  to  determine  the 
sensitivity  and  reliability  of  NDI  procedures  presently  employed  by  the  participating  laboratories  and  to  establish  whether  or  not  the 
procedures  would  be  adequate  for  the  implementation  of  a  damage-tolerance  based  maintenance  approach  or  whether  improved 
methods  are  required. 

In  this  demonstration,  the  bolt  holes  of  several  service-expired  compressor  disks  and  spacers  from  the  J85-CAN40  engine  were 
inspected  using  several  NDI  procedures  including  manual  and  automated  eddy  current,  automated  ultrasonics,  X-ray,  optical 
microscopy,  liquid  penetrant  and  magnetic  particle  inspections.  Service-induced,  low  cycle  fatigue  cracks  of  various  sizes  were  present 
in  some  of  the  bolt  holes.  After  Inspection,  components  were  pry  opened  for  verification  of  cracks.  From  the  NDI  and  destructive  test 
data,  POD  and  lower  95%  confidence  curves  as  a  function  of  crack  size  were  determined  for  all  techniques  investigated  and  are 
described  in  this  report. 


1.  INTRODUCTION 

Components  of  aircraft  engines  are  retired  when  they  have  reached  a  given  number  of  operational  cycles  known  as  tbe  "Safe  Life 
Limit"  which  is  based  on  an  acceptably  low  probability  of  the  formation  of  a  detectable  crack.  However,  the  majority  of  parts  at 
retirement  still  have  useful  life  which  will  not  be  fully  utilized.  The  costs  and  logistics  associated  with  spare  part  replacement  under 
the  "safe  life"  maintenance  philosophy  are  high.  Therefore,  the  development  of  an  attractive  life  management  procedure  that  would 
allow  continued  safe  use  of  components  beyond  the  safe  life  limit  is  of  interest  to  the  air  forces  of  several  NATO  countries.  The 
foremost  requirement  known  is  that  any  new  method  must  not  jeopardize  operational  safety. 

The  U,S,  Air  Force  has  recently  implemented  a  new  maintenance  philosophy  known  as  "Retirement  For  Cause"  (RFC)  to  extend  the 
use  of  gas  turbine  engine  parts  beyond  their  original  design  safe  life  cycle.  This  is  a  result  of  the  Engine  Structural  Integrity  Program 
(ENSIP)  as  defined  in  MIL-STD-1783,  The  RFC  approach  is  based  on  a  "Damage  Tolerance"  (DT)  design  philosophy  which  assumes 
ftat  all  parts  contain  flaws.  By  using  routine  nondestructive  inspections  and  fracture  mechanics  predictions,  the  DT  approach  ensures 
that  the  flaws  will  not  grow  to  critical  size  during  service. 

Inspection,  according  to  damage  tolerance  criteria,  requires  that  the  NDI  procedures  be  quantified  in  terms  of  their  sensitivity  and 
reliability  as  defined  by  probability  of  detection  (POD)  and  confidence  limit  measurements.  The  POD  for  NDI  procedures  can  be 
assessed  experimentally  by  inspecting  statistically  valid  numbers  of  flawed  and  flaw-free  parts  using  procedures  that  duplicate 
maintenance  inspections,  A  comprehensive  document  describing  testing  and  evaluation  procedures  for  assessing  the  capability  of  an 
NDI  system  using  POD  and  confidence  limits  has  been  published  by  AGARD  [2],  The  present  work  uses  Reference  2  as  a  guideline 
to  assess  the  NDI  procedures  employed  by  six  laboratories  from  four  NATO  countries  that  participated  in  this  demonstration  project. 
The  aim  of  the  project  is  to  determine  the  degree  of  reliability  and  the  level  of  sensitivity  of  NDI  procedures  presently  employed  by 
the  participating  laboratories.  The  results  of  this  study  will  be  useful  in  determining  whether  or  not  the  employed  NDI  procedures  are 
adequate  for  the  implementation  of  a  DT-based  maintenance  approach,  and  therefore  whether  improved  methods  are  needed, 

2.  EXPERIMENTAL  MATERIALS  AND  METHODS 


2.I.  Test  Gomponents 

The  test  components  used  in  this  study  were  service-expired  compressor  disks  and  spacers  from  the  J85-CAN40  engine  (Figures 
1  and  2),  Although,  they  were  originally  operated  under  the  safe-life  philosophy,  these  parts  had  remained  in  service  beyond  the  safe- 
life-limit  due  to  logistic  problems  with  part  replacement,  A  total  of  seven  sixth  stage  compressor  disks  and  six  fourth  stage  spacers  were 
employed.  The  disks  and  spacers  are  fabricated  from  precipitation  hardened  martensitic  stainless  steel  (AM355),  Each  disk  has  40  bolt 
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holes  of  4.8  mm  (0.1 88")  diameter.  Each  spacer  has  two  integral  segments  with  40  bolt  holes  in  each  segment  of  the  same  diameter 
as  those  of  the  disks.  The  thickness  of  the  discs  and  spacers  in  the  bolt  hole  region  is  1 .9  mm  (0.075").  In  service,  these  components 
are  subject  to  low  cycle  fatigue,  and  as  a  result,  cracks  originating  at  the  bolt  holes  were  present  in  all  the  retired  parts.  Therefore  only 
the  bolt  holes  were  inspected. 

2.2.  NDl  Techniques  and  Procedures 

A  number  of  NDI  techniques  were  used  to  examine  the  bolt  holes  of  the  test  components.  The  techniques  included  liquid 
penetrant  inspection  (LPI),  eddy  current  inspection  (ECI),  magnetic  particle  inspection  (MPI),  optical  microscopic  inspection  (OMI), 
ultrasonic  leaky-wave  inspection  (ULI)  and  X-ray  inspection  (XRI).  Various  combinations  of  these  inspections  were  carried  out  at  six 
different  test  establishments,  on  different  subsets  of  the  test  components.  The  techniques  and  procedures  employed  are  explained  in 
further  detail  in  the  following  paragraphs. 

2.2.1.  Liquid  Penetrant  Inspection 

In  general,  the  LPI  method  involves  several  steps  as  described  in  the  following.  First  the  parts  are  cleaned  with  a  solvent,  then 
they  are  soaked  in  a  penetrant  (fluorescent  dye)  for  a  period  of  time  and  subsequently  washed  to  remove  excessive  dye  from  the  surface, 
Emulsifier  is  then  applied  to  bring  out  the  penetrant  trapped  in  the  cracks  and  a  developer  is  used  to  highlight  the  flaw  under  ultraviolet 
light.  The  parts  are  visually  examined  by  an  inspector  (certified)  under  ultraviolet  light  and  cracks  are  identified  and  measured.  LPI 
can  only  indicate  surface  connected  cracks  and  measure  their  size  as  seen  on  the  part  surface.  The  entire  LPI  process  as  well  as  the  type 
of  chemicals  and  dwell  periods  used  are  important  in  this  inspection.  Liquid  penetrant  inspection  was  carried  out  by  five  participating 
laboratories.  Appendix  A  provides  details  of  the  chemicals  and  procedures  used  by  each  laboratory  for  LPI  of  the  test  parts.  Most 
laboratories  used  a  military  or  ASTM  standard  for  their  LPI  process. 

2.2.2.  Magnetic  Particle  Inspection 

Magnetic  particle  inspection  is  accomplished  by  inducing  a  magnetic  field  in  a  ferromagnetic  part  and  applying  either  a  dry 
magnetic  powder  or  a  liquid  suspension  of  iron  particles  on  the  surface  being  inspected.  Cracks  cause  local  perturbations  in  the 
magnetic  field  which  attract  the  magnetic  particles  producing  indications  visible  by  fluorescence  under  ultraviolet  light.  Surface 
connected  or  close-to-surface  cracks  can  be  detected  and  sized  by  an  experienced  operator.  Important  factors  in  the  MPI  are  the 
magnitude  and  the  direction  of  the  applied  magnetic  field  with  respect  to  crack  orientation.  Three  of  the  participating  laboratories 
performed  MPI  on  the  test  components  and  information  on  the  procedures  used  is  provided  in  Appendix  A.  These  procedures  were 
based  on  MIL-STD-1949. 


2.2.3.  Eddy  Current  Inspection 

Principles  of  electromagnetic  induction  are  used  in  eddy  current  inspection  to  detect  surface  and  near  surface  flaws  in 
electrically  conductive  materials.  Inspections  are  done  by  bringing  a  coil  (probe)  carrying  an  alternating  current  close  to  the  test 
material.  In  this  way,  an  alternating  magnetic  field  is  induced  in  the  material  which  generates  a  small  current  (eddy  current).  This  eddy 
current,  in  turn,  generates  its  own  magnetic  field  which  interacts  with  the  magnetic  field  of  the  exciting  probe.  The  presence  of  flaws 
interferes  with  the  passage  of  the  eddy  current  and  changes  the  impedance  of  the  coil  which  can  be  detected  and  measured.  Instrument 
frequency,  gain  and  threshold  as  well  as  the  probe  proximity  to  the  material  and  crack  geometry  are  some  of  the  important 
considerations  in  this  method. 

The  eddy  current  technique  is  widely  used  for  the  detection  of  fatigue  cracks  around  fastener  holes  and  many  special  probes 
and  instruments  with  a  range  of  capabilities,  either  manual  or  automated,  are  commercially  available  for  bolt  hole  inspections.  This 
method  was  employed  by  five  of  the  laboratories  that  participated  in  the  round  robin  tests  using  different  instruments  and  procedures 
as  described  in  Appendix  A.  Most  of  the  laboratories  used  manual  or  semi-automated  (with  spinning  probes)  eddy  current  instruments, 
which  are  designated  as  ECI,  and  some  also  employed  automated  scanners  with  operator  identifying  defective  bolt  holes  (ECI-A)  or 
using  pattern  recognition  to  classify  defective  holes  (ECI-AP). 

2.2.4.  Optical  Microscopic  Inspection 

In  this  method,  an  optical  microscope  is  used  to  inspect  components  for  surface-breaking  cracks.  The  surface  finish,  the  crack 
opening  and  the  crack  surface  length  are  important  factors  in  the  success  of  OMI.  The  geometry  of  the  test  components  makes  it 
difficult  to  examine  the  bore  surface  of  the  holes.  Only  one  laboratory  employed  OMI  as  an  NDI  tool  for  detecting  bolt  hole  cracks 
in  this  round  robin  exercise  but  no  information  on  the  procedure  was  provided. 

2.2.5.  X-Ray  Inspection 

This  inspection  is  based  on  the  differential  absorption  of  X-rays  by  the  material  being  inspected.  Variations  in  the  density, 
thickness  and  composition  can  cause  variations  in  the  intensity  of  the  transmitted  radiation  and  can  be  recorded  on  a  sheet  of  film  which 
appear  as  variations  in  shades  of  grey  in  the  developed  film.  The  location,  size  and  orientation  of  cracks  with  respect  to  the  X-ray  beam 
as  well  as  the  material,  thickness  and  procedures  are  important  in  the  crack  detection  process.  This  method  was  used  by  only  one 
laboratory  and  details  of  the  procedure  are  given  in  Appendix  A. 
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2.2.6.  Ultrasonic  Leaky-wave  Inspection 

The  ultrasonic  leaky-wave  technique  is  based  on  the  transmission  of  high  frequency  sound  waves  through  a  liquid  medium 
(water)  onto  the  surface  of  the  test  component  at  an  oblique  angle.  This  angle  is  selected  such  that  the  compressional  waves,  travelling 
in  the  liquid,  are  mode  converted  into  surface  waves  in  the  test  material.  When  the  surface  waves  encounter  sharp  edges  or  cracks,  they 
are  partly  scattered,  "leaking”  their  energy  back  into  the  water  which  is  picked  up  by  a  transducer  and  presented  as  an  echo  on  a  CRT. 
This  echo  is  monitored  during  inspection,  which  is  often  performed  in  an  automated  ultrasonic  C-scan  system,  and  is  recorded  in  a  C- 
scan  format.  The  surface  waves  interact  with  surface  and  near  surface  cracks  which  lie  perpendicular  to  the  propagation  direction. 
Because  of  the  rapid  decay  of  the  surface  waves,  reflections  from  edges  or  cracks  can  be  well  localized.  The  success  of  this  technique 
depends  on  factors  such  as  surface  finish,  crack  size  and  orientation  as  well  as  the  geometry  of  the  test  piece  and  the  equipment  setup. 
Only  one  laboratory  employed  the  ULI  method.  More  information  on  this  technique  can  be  found  in  Reference  [3]. 

2..3.  Destructive  Crack  Verification 

After  completion  of  all  NDI,  the  existence  of  cracks  in  the  bolt  holes  was  verified  by  destructive  testing.  The  destructive  crack 
verification  was  carried  out  at  lAR/NRC  on  every  component  except  for  three  disks  (  No.  D,  F  and  G).  These  disks  have  not  been 
returned  to  Canada.  The  crack  verification  process  is  schematically  illustrated  in  Figure  3.  First,  approximately  2cm  x  3cm  samples 
were  cut  from  the  region  surrounding  each  bolt  hole  using  a  laser  cutting  technique.  Each  sample  was  then  sectioned  into  two  pieces 
along  the  diameter  of  the  bolt  hole.  In  the  inward  piece  (the  larger  section),  a  notch  was  introduced  in  the  side  opposite  to  the  bolt  hole 
and  the  sample  was  then  pried  open  by  closing  the  notch  in  a  vice.  The  second  piece  was  loaded  in  three-point  bending  until  failure. 
In  both  cases,  crack  faces  were  under  tension  during  loading.  To  monitor  the  pry  opening  process,  the  sections  were  examined 
periodically  under  an  optical  microscope  to  check  the  crack  opening  and  if  multiple  crack  sites  existed.  After  pry  opening,  the  fracture 
surfaces  were  examined  under  an  optical  or  a  scanning  electron  microscope  (SEM)  as  required  depending  on  the  crack  size.  Under  the 
microscope,  the  service-induced  LCF  cracks  were  easily  recognized  from  the  rupture  failure  due  to  their  smooth  and  oxidized  surfaces 
and  the  crack  size  was  measured.  The  specimens  that  did  not  reveal  a  crack  on  the  fracture  surfaces  were  further  examined  on  the  bolt 
hole  surface  to  make  sure  that  a  crack  was  not  missed  during  the  pry  opening  operation. 

2.4.  Statistical  Analysis  of  Data 

The  results  of  NDI  techniques  used  in  this  program  consisted  of  three  possibilities.  A  "hit"  is  when  a  crack  exists  and  the  NDI 
technique  identifies  the  crack  while  a  "miss"  is  when  a  crack  exists  but  the  NDI  technique  does  not  detect  it.  A  "false  call"  refers  to 
the  case  where  a  crack  does  not  exist  but  the  NDI  method  incorrectly  indicates  a  crack.  Flit  or  miss  rates  are  defined  as  the  number  of 
cracks  detected  or  missed  over  the  total  cracks  present  while  the  false  call  rate  is  the  ratio  of  false  calls  to  the  total  number  of  crack-free 
sites.  The  hit,  miss  and  false  call  rates  were  found  for  each  procedure.  The  inspection  results  were  statistically  evaluated  in  terms  of 
probability  of  detection  (POD)  as  a  function  of  crack  size  (maximum  length)  and  the  95%  lower  confidence  bound  on  POD  curve. 

For  POD  analysis,  values  of  1  and  0  are  given  to  "hit"  and  "miss",  respectively.  For  "hit/miss"  type  data  generated  on  the  basis 
of  one  inspection  per  crack,  either  the  log-normal  or  the  log-logistic  distribution  can  be  used.  A  comparison  of  POD  curves  using  these 
two  distributions  is  made  in  Reference  [9].  It  has  been  recommended  that  the  log-normal  function  be  used  for  determining  POD  and 
confidence  limits  [2,9].  The  mathematical  functions  underlying  this  distribution  are  described  in  the  literature  [e.g.2,4,5].  The  functional 
form  of  the  log-normal  distribution  is: 

Pi  =  1  -  Q(Zi) 

In(ai)  -  \L  (1) 

for  Zj  =  - 

o 

where  Q(z)  is  the  standard  normal  survivor  function,  Zi  is  the  standard  normal  variate,  and  p  and  o  are  the  location  and  scale  parameters 
of  the  POD  curve.  The  location  and  scale  parameters  were  estimated  using  the  method  of  maximum  likelihood  estimators  (MLE)  as 
suggested  in  Ref  2.  The  purpose  of  the  MLE  is  to  find  estimates  of  the  parameters  that  maximize  the  probability  of  obtaining  the 
observed  data.  The  following  equation  from  Reference  [2]  was  used. 

L(Pi;ai,  X.)  =P;‘  •(!  (2) 


where  Pi  is  the  probability  of  detection  of  crack  size  and  Xi  is  the  inspection  outcome;  0  for  a  miss  and  1  for  a  hit.  Further  information 
on  this  procedure  can  be  found  in  References  [2,4  and  7]  while  details  of  the  functions  and  computational  procedures  used  in  this 
program  to  calculate  parameters  and  determine  POD  curves  are  provided  in  a  separate  document  [8].  To  determine  the  confidence 
bound  on  the  log-normal  POD  curve,  the  method  derived  by  Cheng  and  lies  [6,7]  was  used. 

The  existence  of  false  calls  in  inspection  data  can  bias  a  POD  curve,  because  when  false  calls  are  high,  a  portion  of  the  detected 
cracks  are  likely  to  be  false  indications  at  crack  sites.  In  such  cases,  the  inspection  results  are  more  correctly  called  probability  of 
indication  (POI)  rather  than  probability  of  detection  (POD),  as  the  effect  of  false  calls  should  be  considered.  Following  the  analysis 
described  in  Ref  2,  we  define  POI(a)  as  the  probability  of  obtaining  an  indication  of  a  crack  at  crack  length  a,  POD(a)  the  probability 
of  correctly  detecting  a  crack  at  crack  length  a,  and  p  as  the  probability  of  false  indication  or  the  false  call  rate.  It  is  assumed  that  p  is 
independent  of  crack  size.  The  relationship  between  these  variables  can  be  written  as: 
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POI(a)  =  p  U  POD(a)  -  p  fl  POD(a) 


(3) 


which  states  that  the  POI  is  given  by  the  sum  of  the  false  calls  p  and  the  correct  indications  POD,  minus  the  overlap  where  both  occur 
together.  This  can  be  expanded  to: 


POI(a) 

or 

POD(a) 


=  p  +  (1  -  p)  POD(a) 

=  POI(a)  -  P 
(1  -  P) 


(4) 


Statistical  methods  in  the  literature  for  finding  POD(a)  usually  give  results  for  POI(a),  and  assume  a  small  false  call  rate.  It  can 
be  seen  that  for  a  small  false  call  rate,  the  POI(a)  will  be  a  good  representation  of  the  POD(a).  Reference  2  suggests  a  maximum  false 
call  rate  of  5%  (or  p  =  0.05)  to  ensure  an  accurate  modelling  of  the  true  POD.  In  this  work,  both  POI  and  POD  curves  as  well  as  the 
90/95%  values  on  POI  and  POD  were  calculated  for  all  inspections.  For  inspections  with  less  than  5%  false  calls,  the  POI  and  POD 
curves  overlap,  therefore,  only  the  POD  curve  is  shown.  For  inspections  with  false  call  rate  greater  than  5%,  both  POI  and  POD  curves 
are  presented. 

To  have  a  better  estimate  of  the  true  POD,  it  is  possible  to  calculate  the  POD  at  any  crack  length  from  the  POI,  and  then  use 
this  calculated  POD  to  estimate  the  parameters  defining  the  log-normal  curve  which  best  models  the  POD  curve.  This  allows  the  use 
of  the  Cheng  and  lies  [5,6]  method  of  obtaining  confidence  bounds  on  the  estimate  of  the  true  POD  curve. 

The  crack  length  at  a  90%  POD  level  and  95%  confidence  ("90/95%"  length)  is  often  used  as  the  initial  flaw  size  in  the  damage 
tolerance-based  design  and  maintenance  approach.  Therefore,  the  90/95%  crack  length  values  were  used  as  a  simplistic  way  of 
comparing  different  NDI  procedures.  It  must  be  pointed  out  that  not  all  of  the  inspections  were  carried  out  on  the  same  set  of 
components,  since  some  laboratories  performed  inspections  on  a  limited  number  of  components,  however,  comparison  of  the  data  from 
different  sets  is  reasonable  considering  that  the  materials  and  bolt  hole  geometries  were  nominally  identical.  Also,  it  must  be  mentioned 
that  the  POD  data  presented  in  this  report  are  based  on  the  results  of  inspections  performed  during  the  present  investigation  and  cannot 
be  generalized  for  every  procedure  or  component.  If  any  of  the  variables  involved  in  each  NDI  process  (e.g.  operator,  instruments, 
settings,  component,  flaw  types,  etc.)  are  altered,  it  is  expected  that  the  POD  data  will  be  different, 

3.  RESULTS 

3.1.  Inspection  Data 

Table  I  identifies  components  that  were  inspected  at  each  test  site.  The  complete  inspection  data  is  presented  in  tabular  form 
in  Appendix  B.  Each  table  contains  all  the  NDI  and  destructive  test  results  for  one  component.  Inspection  results  provided  by  the 
participating  laboratories  are  listed  for  different  techniques  with  "h"  indicating  a  hit,  "m"  representing  a  miss  and  "f '  indicating  a  false 
call.  These  allocations  are  based  on  the  outcome  of  destructive  tests  which  are  also  presented  along  with  the  crack  size  (maximum 
length  and  total  area),  the  number  of  cracks  in  each  bolt  hole  and  the  location  of  the  largest  crack.  In  the  case  of  multiple  cracks,  only 
the  largest  one  was  considered  in  the  analysis.  No  attempt  was  made  to  evaluate  the  performance  of  the  NDI  procedures  in  terms  of 
inspection  time,  cost,  simplicity,  or  their  ability  to  estimate  the  crack  size  . 

3.2.  Crack  Profiles 


Destructive  tests  and  examination  of  fracture  surfaces  indicated  that  most  cracks  initiated  near  the  edges  of  the  holes  and  formed 
comer  cracks.  Often,  initiation  occurred  at  the  bore  of  the  holes  and  grew  radially  inward  towards  the  centre  of  the  component.  There 
were  cracks  which  did  not  touch  the  top  or  bottom  surfaces  and  these  were  termed  middle  cracks  as  well  as  cracks  which  touched  both 
surfaces  and  were  referred  to  as  through  cracks.  Examples  of  different  crack  types  are  provided  in  Figures  4  and  5.  Figure  6  provides 
the  distribution  of  different  crack  types  as  a  function  of  crack  length  indicating  that  the  majority  of  cracks  were  small  (less  than  0.5 
mm  in  length)  comer  cracks.  Most  holes  had  a  single  crack  but  multiple  cracks,  as  many  as  seven,  were  also  seen  in  many  holes.  Some 
cracks  did  not  occur  along  the  radii  of  the  discs;  many  of  these  were  initiated  at  what  appeared  to  be  voids  or  inclusions  in  the  material 
and  were  often  accompanied  by  larger  cracks  on  the  radii.  Some  totally  internal  cracks  as  well  as  outward  propagating  cracks  were  also 
seen. 


The  shape  of  cracks  varied  depending  on  their  location;  middle  cracks  were  mostly  semi-elliptical,  comer  cracks  appeared  as 
a  quarter  of  an  ellipse  and  through  cracks  were  close  to  rectangular  in  shape.  A  combination  of  the  above  shapes  was  often  seen  in  the 
case  of  multiple  cracks.  The  crack  size  was  measured  in  terms  of  total  area  of  crack  face  and  the  maximum  length.  In  cases  where 
failure  did  not  occur  through  a  crack,  the  bore  surface  of  the  bolt  hole  was  examined  and  if  a  crack  was  found,  the  crack  length  at  the 
surface  was  measured. 

3.3.  Statistical  Analysis 

Table  II  contains  a  summary  of  the  test  results  which  compare  the  performance  of  the  different  NDI  procedures  used  at  the 
participating  test  sites.  The  number  of  bolt  holes  inspected  by  each  procedure  is  given  along  with  the  total  number  of  cracks  in  the 
population  as  identified  by  destructive  crack  verification  tests.  Also,  the  number  and  percentage  of  cracks  detected  (hit),  missed  or 
incorrectly  identified  (false  calls)  as  well  as  the  90/95%  crack  length  on  POI  and  POD  are  provided. 
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Figure  7  shows  histograms  of  the  percentages  of  cracks  missed  by  each  inspection  procedure,  organized  by  crack  type.  Through 
cracks  were  the  easiest  type  to  detect  by  all  techniques,  because  they  were  generally  larger  and  open  to  surfaces.  However,  only  eddy 
current  inspection  was  able  to  detect  more  than  90%  of  through  cracks.  Middle  cracks  were  the  hardest  to  detect  for  all  methods,  mainly 
because  these  cracks  were  mostly  small  and  it  was  physically  difficult  to  access  or  view  the  bore  surface  of  the  holes.  There  were  a  large 
number  of  small  (<0.5  mm)  comer  cracks  which  were  missed  by  all  methods.  In  all  cases,  the  eddy  current  inspections  were  the  best 
performers. 

Probability  of  detection  relationships  to  crack  length  are  shown  in  Figures  8-25  for  the  NDI  procedures  used  in  this  program. 
The  figures  show  the  actual  inspection  results,  1  for  a  detection  and  0  for  a  miss,  the  mean  POD  and  POI  (if  false  call  rate>  5%)  as  well 
as  the  95%  lower  confidence  curves  on  POI  and  POD  calculated  using  the  log-normal  distribution  with  the  method  of  maximum 
likelihood  estimators.  Note  that  false  calls  are  taken  into  account  in  the  POD  but  not  in  the  POI  curves.  The  false  call  rate  for  each  NDI 
procedure  is  also  shown  on  the  graphs. 

3.3.1.  Probability  Data  for  Liquid  Penetrant  Inspections 

The  false  call  rates  for  liquid  penetrant  inspections  were  less  than  3%  and  therefore  only  the  POD  curves  are  shown  in  Figures 
8-12.  The  LPI  POD  results  of  different  organizations  were  very  similar  with  the  exception  of  organization  VI  which  was  different.  The 
LPI  data  of  this  laboratory  obtained  on  160  bolt  holes,  which  happen  to  contain  only  small  (<2  mm)  cracks,  showed  only  a  11% 
detection  rate  with  no  false  calls.  The  other  four  laboratories  had  detection  rates  of  25-28%  and  false  call  rates  of  0.9-2. 6%.  Despite 
the  low  detection  rate  for  that  one  test  site,  at  1 .9  mm,  the  90/95%  crack  length  was  less  than  those  for  the  LPI  processes  of  the  other 
four  laboratories  which  had  90/95%  values  in  the  range  of  2.7-3.7  mm.  These  are  close  to  the  values  obtained  in  the  earlier  investigation 
using  similar  disks  [1,9]  implying  that  the  LPI  results  can  be  very  reproducible  if  the  procedure  remains  similar.  The  lower  90/95% 
crack  length  for  organization  VI  could  be  attributed  to  the  small  sample  population  used  by  that  test  site  and  the  fact  that  there  were 
no  missing  cracks  larger  than  1 .8  mm  in  their  data  base.  With  the  exception  of  a  4.6  mm  crack  which  was  missed  by  the  laboratory  I, 
all  cracks  larger  than  2.6  mm  were  detected  by  the  LPI  procedures  employed.  Since  the  LPI  method  relies  on  penetration  of  a  liquid 
into  cracks,  the  tightness  of  cracks  may  have  contributed  to  missing  a  large  number  of  small  cracks. 

3.3.2.  Probability  Data  for  Magnetic  Particle  Inspections 

Magnetic  particle  inspections  were  performed  at  three  facilities  on  three  different  subsets  of  the  sample  population.  The  MPI 
tests  achieved  detection  rates  of  26-35%,  90/95%  values  of  1 .9-3.7  mm  and  false  call  rates  of  0-10.5%.  The  largest  crack  missed  by 
these  inspections  was  in  the  1.6-4. 6  mm  range.  These  numbers  and  the  POD  curves  (Figures  13-15)  indicate  that  the  MPI  and  LPI 
procedures  produced  similar  results  for  the  test  components  of  this  exercise.  Comparison  of  the  MPI  results  for  these  three  laboratories 
clearly  indicate  that  organization  I  has  achieved  zero  false  calls  at  the  expense  of  missing  a  large  number  of  small  cracks  while 
Organization  III  has  detected  a  larger  number  of  small  cracks  but  produced  a  high  false  call  rate.  In  this  case,  a  portion  of  the  detected 
cracks  are  likely  to  be  false  indications  at  crack  sites  which  are  not  reflected  in  the  POI  but  are  considered  in  the  POD  data. 

3.3.3.  Probability  Data  for  Eddy  Current  Inspections 

Figures  16-22  show  POD/POI  curves  for  ECI  procedures.  Except  for  Organization  1  which  had  a  relatively  low  detection  rate 
of  28%  and  a  high  90/95%  value  of  2.64  mm,  the  ECI  results  for  all  other  laboratories  were  similar  and  the  detection  rates  were  in  the 
range  of  47-79%  and  the  90/95%  values  in  the  range  of  0.84-1 .8  mm.  The  false  call  rate  for  that  one  laboratory  was  also  very  low 
(0.87%)  as  compared  to  the  others  (3.4-12.5%).  This  implies  that  this  particular  inspection  may  have  been  done  using  less  sensitive 
instruments  or  settings  (e.g.  high  threshold  level),  therefore,  a  large  number  of  small  cracks  have  been  missed.  The  largest  crack  missed 
by  the  ECI  procedure  varied  from  one  laboratory  to  another  and  was  in  the  range  of  1.1 -4. 6  mm. 

In  addition  to  manual  eddy  current  inspections  (ECI)  which  were  used  by  all  test  sites,  one  of  the  laboratories  also  performed 
inspections  using  an  experimental  automated  system  with  pattern  recognition  capability  using  a  non-contact  spinning  probe.  Automated 
eddy  current  inspections  were  performed  and  the  signals  were  stored.  The  eddy  current  signals  were  interpreted  both  by  an  operator 
(ECI-A)  as  well  as  by  pattern  recognition  technique  as  designated  by  ECI-AP.  In  contrast  to  what  was  expected,  neither  automated 
inspections  nor  the  pattern  recognition  analysis  achieved  any  better  results  than  those  of  the  manual  inspections.  The  subsequent 
analysis  of  the  automated  ECI  signals  indicated  that  on  many  occasions  during  inspections,  the  eddy  current  probe  had  touched  the 
bore  of  the  bolt  holes  producing  false  indications.  While  the  result  of  automated  ECI  was  somewhat  disappointing,  nevertheless  it 
illustrated  that  automation  of  inspections  may  not  necessarily  provide  better  results  unless  the  equipment  is  properly  designed  and  set 
up  for  specific  inspections.  Overall,  eddy  current  procedures  produced  the  best  POD  results  among  the  techniques  investigated  in  this 
exercise. 

3.3.4.  Probability  Data  for  Optical  Microscopic  and  X-Ray  Inspections 

These  inspections  produced  low  false  call  rates  but  missed  a  large  number  of  cracks  as  seen  in  the  POD  data  (Figures  23,24). 
The  largest  cracks  missed  were  6.6  mm  for  the  optical  technique  and  5.3  mm  for  the  X-ray  method.  The  90/95%  crack  length  found 
for  the  optical  method  was  26.7  mm  and  for  the  X-ray  technique  was  16.5,  indicating  that  these  methods  are  not  appropriate  for 
detecting  LCF  cracks  in  engine  components  of  the  type  investigated  here.  The  OMI  inspections  suffer  because  of  the  component  surface 
roughness,  tightness  of  cracks  and  the  difficulty  in  viewing  the  bore  surface.  X-ray  inspections  of  these  components  are  also  difficult, 
due  to  component  material  and  geometry  and  the  small  crack  sizes. 
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3.3.5.  Probability  Data  for  Ultrasonic  Leaky-wave  Inspection 

Although  an  attempt  was  made  to  inspect  all  components  using  the  ultrasonic  leaky-wave  approach,  only  results  for  the  disks 
were  considered  complete  since  the  geometry  of  the  spacers  did  not  allow  inspection  of  inner  surfaces  by  this  method.  Therefore,  only 
the  data  for  disks  were  analyzed  and  the  POD  curves  are  shown  in  Figure  25.  The  false  call  rate  was  1 .4%,  the  largest  crack  missed 
was  1.8  mm  and  the  90/95%  crack  length  was  2  mm.  These  results  are  very  similar  to  those  obtained  in  the  previous  investigation  using 
similar  disks  [1,9]. 

4.  EFFECT  OF  FALSE  CALLS 

If  noise  is  present  in  the  response  signal,  false  indications  can  result  if  noise  response  from  a  crack-free  site  is  interpreted  as 
being  caused  by  a  crack.  False  calls  are  undesirable  for  economic  reason,  but  often  there  is  a  trade  off  between  the  false  call  rate  and 
the  ability  to  detect  small  cracks.  As  shown  by  the  POI  and  POD  curves  as  well  as  the  associated  90/95%  crack  length  values,  for  a 
given  inspection  procedure,  high  false  calls  only  marginally  improve  the  chance  of  identification  of  cracks.  However,  the  true 
probability  of  detection  (POD)  decreases  more  with  increasing  false  calls  as  illustrated  in  Figure  26  for  a  typical  inspection  with  a  90% 
true  POD  and  no  false  calls.  This  indicates  that  every  inspection  process  has  a  certain  detection  limit  indicated  by  the  signal-to-noise 
ratio  which  is  governed  by  many  factors  including  the  physics  of  the  procedure,  instruments  and  settings  employed,  signal  processing 
methods,  the  test  material  and  geometry,  the  operator,  etc.  Hence,  any  attempt  to  increase  the  number  of  hits  by  such  means  as  using 
high  instrument  gain  or  low  threshold  level  and  deliberately  identifying  noisy  signals  as  cracks  without  improving  the  signal-to-noise 
ratio  will  only  marginally  increase  the  probability  of  indication  but  not  the  true  probability  of  detection. 

5.  MULTIPLE  INSPECTIONS 

The  purpose  of  repeated  inspections  is  to  increase  the  POD.  The  POD  calculations  for  double  inspection  are  provided  in  Ref  [2]. 
We  attempted  to  combine  the  data  from  two  inspections  of  the  same  or  different  techniques.  The  resulting  POD  curves  indicated 
improvements  when  the  two  procedures  were  different  and  some  of  the  cracks  missed  by  one  inspection  were  picked  up  by  the  second 
one.  However,  in  many  cases  the  inspection  which  had  the  higher  hit  rate  had  picked  up  almost  all  the  cracks  that  the  second  one 
detected  and  therefore  the  combined  POD  remained  unchanged. 

6.  CONCLUSIONS 

The  bolt  holes  of  seven  compressor  disks  and  six  spacers  from  the  J85-CAN40  engine  were  inspected  by  a  number  of  NDI 
procedures  at  different  test  sites.  Four  of  the  disks  and  all  of  the  spacers  were  sectioned  destructively  to  verify  the  presence  of  cracks 
and  to  measure  crack  size.  Based  on  the  NDI  and  destructive  results,  the  probability  of  indication  and  the  probability  of  detection 
relationships  with  crack  size  were  found  for  each  procedure  using  the  log-normal  distribution  with  maximum  likelihood  estimators. 
The  POD  data  was  used  to  evaluate  different  NDI  procedures  in  terms  of  sensitivity  and  reliability. 

Among  the  techniques  investigated,  eddy  current  procedures  had  the  highest  sensitivity  and  reliability  in  detecting  LCF  cracks 
in  these  specific  components  as  indicated  by  the  POD-crack  size  relationships  and  the  crack  sizes  detectable  at  90%  POD  with  95% 
confidence  level.  Automation  of  this  procedure,  in  terms  of  inspection  or  signal  interpretation,  may  improve  the  results  only  if  the 
system  is  designed  and  operated  properly.  Ultrasonic  leaky- wave  POD  results  were  also  comparable  to  the  ECI,  Liquid  penetrant  and 
magnetic  particle  inspections  produced  similar  POD  results  on  the  components  but  LPI  results  appeared  to  be  more  reproducible.  X-rays 
and  optical  microscopic  inspections  did  not  detect  the  majority  of  cracks  and  are  considered  inappropriate  for  application  to  engine 
parts  of  the  type  investigated. 

False  calls  only  marginally  increase  the  probability  of  indication  but  not  the  true  probability  of  detection.  To  improve  the  POD, 
signal  to  noise  ratio  should  be  increased.  Combining  data  for  the  best  and  worst  of  the  same  technique  resulted  in  POD  improvement 
in  the  case  of  LPI  and  MPI  methods  but  no  change  for  the  ECI  technique.  Benefits  from  repeated  inspections  are  realized  only  when 
the  two  procedures  are  different  and  some  of  the  cracks  missed  by  one  inspection  are  picked  up  by  the  second  one. 

Damage  tolerance  criteria,  based  on  the  U.S.  Air  Force  MIL  STD  1783,  requires  repeatable  detection  of  cracks  with 
characteristic  dimensions  less  than  0.5  mm  at  90%  POD  and  95%  confidence.  If  this  criteria  is  to  be  applied  to  the  NDI  procedures 
investigated,  none  of  the  inspections  are  adequate  for  damage  tolerance  application.  Eddy  current  procedures  have  the  most  potential 
to  achieve  such  requirements  if  further  improvements  are  made  in  the  signal-to-noise  ratio. 
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Table  I  Summary  of  disks  and  spacers  that  were  investigated  by  different  inspection  techniques  at  the  indicated  organizations. 


An  "x"  in  the  appropriate  box  indicates  that  the  inspection  indicated  was  performed  on  that  component. 
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Figure  1.  A  compressor  disk  of  the 
type  used  in  this  study. 


Figure  2.  A  compressor  spacer  of  the 
type  used  in  this  study. 
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Figure  3.  Schematic  illustration  of  sectioning,  pry  opening,  and  microscope  examination  of  bolt  hole 
specimens. 
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c)  A  middle  crack 


Figure  4.  Examples  of  different  crack  types  in  the  bolt  holes 


Figure  5.  a)  A  small  crack  in  the  bolt  hole  bore 


Figure  5.  b)  A  crack  initiating  cavity 


Figure  5.  c)  A  cellulose-acetate  replica  of  the  disk  surface, 
showing  a  crack 
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Figure  11.  Dependence  of  POD  on  crack  length,  LPI  organization  IV 
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Figure  12.  Dependence  of  POD  on  crack  length,  LPI  organization  VI 


1 


y'./' 
/ / 

/  y 

' 

// 

// 

'/ 

h 

1 

// 

jl 

li 

ji 

90/95%  length  1.95  mm  on  POI 

1 

i 

90/95%  length  1.98  mm  on  POD 

j 

- probability  of  detection  (POD) 

- 95%  confidence  level  on  POD 

^  inspection  results 


1  2  3  4  5  6  7 

crack  length  (mm) 

Figure  14.  Dependence  of  POD  on  crack  length,  MPI  organization  II 
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Figure  15.  Dependence  of  POI  and  POD  on  crack  length,  MPI  organization  III 
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Figure  16.  Dependence  of  POD  on  crack  length,  ECI  organization  I 
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Figure  17.  Dependence  of  POI  and  POD  on  crack  length,  ECI  organization  III 
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Figure  18.  Dependence  of  POD  on  crack  length,  ECI  organization  IV 


Figure  19.  Dependence  of  POI  and  POD  on  crack  length,  ECI  organization  V 


probability  probability  probability 


16 


crack  length  (mm) 

Figure  20.  Dependence  of  POI  and  POD  on  crack  length,  ECI  organization  VI 


crack  length  (mm) 

Figure  21.  Dependence  of  POI  and  POD  on  crack  length,  ECI  -  A  organization  IV 
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Figure  22.  Dependence  of  POI  and  POD  on  crack  length,  ECI  -  AP  organization  IV 
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Figure  23.  Dependence  of  POD  on  crack  length,  OMI  organization  VI 
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Figure  24.  Dependence  of  POD  on  crack  length,  XRI  organization  IV 
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Figure  25.  Dependence  of  POD  on  crack  length,  ULI  organization  IV 
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Figure  26.  The  effect  of  false  call  rate  on  probability  of  detection  (POD)  and  probability  of  indication  (POI) 
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LPI  Inspection  Report  Form 

Date:  Dec  1990  Operator:  Laboratory  I 

Part  description:  AGARD  disks  and  spacers 

LPI  system  model  number,  name: 

Standard  procedure: 

MIL  STD  6866:  type  I,  method  B,  sensitivity  level  4 

Inspection  procedure  -  describe  following: 

a.  precleaning 

b.  penetrant  information 

-  6850  01  121  0945  P/N  FP  97A-M 

-  60  min  dwell  time 

c.  penetrant  removal 

d. drying  temperature  and  time 

e.  developer  information  and  time 

-  6850  01  121  0952  P/N  D  76E 

-  45  min 

f.  inspection  method 

-  inspection  under  black  light 

g.  post-cleaning 

Defect  evaluation:  describe  technique  for 
inspection  and  defect  analysis 

-  part  examined  under  black  light  for  crack 
indications,  bore  and  surface  of  bolt  holes 


LPI  Inspection  Report  Form 

Date:  Mar  1991  Operator:  Laboratory  II 

Part  description:  AGARD  disks  and  spacers 

LPI  system  model  number,  name: 

Standard  procedure: 

MIL  STD  6866:  type  I,  method  D,  sensitivity  level  4 

Inspection  procedure  -  describe  following: 

a.  precleaning 

-  acetone,  then  water  rinse 

b.  penetrant  information 

-  Magnaflux  ZL37 

-  30  min  dwell  time 

c.  penetrant  removal 

-  hydrophilic  emulsifier  (Magnaflux  ZR10B)  for  60 
seconds 

d. drying  temperature  and  time 

e.  developer  information  and  time 

-ZPQE 

-  7  min 

f.  inspection  method 

-  inspection  under  black  light 

g.  post-cleaning 

Defect  evaluation:  describe  technique  for 
inspection  and  defect  analysis 

-  part  examined  under  black  light  for  crack 
indications,  bore  and  surface  of  bolt  holes 


LPI  Inspection  Report  Form 

Date:  Jan  1992  Operator:  Laboratory  III 

Part  description:  AGARD  disks  and  spacers 

LPI  system  model  number,  name: 

Standard  procedure: 

MIL  STD  6866:  type  I,  method  D 

Inspection  procedure  -  describe  following: 

a.  precleaning 

-  solvent 

b.  penetrant  information 

-  Magnaflux  ZL27-A 

-  30  min  dwell  time 

c.  penetrant  removal 

-  rinse  in  water  with  15%  hydrophilic  emulsifier 
(Magnaflux  ZR10B) 

d. drying  temperature  and  time 

-  70C  recirculating  oven 

e.  developer  information  and  time 

-  immersion  ZP-14Q 

f.  inspection  method 

-  inspection  under  black  light 

-  measurement  using  vernier  calipers 

g.  post-cleaning 

-  blown  clean 

Defect  evaluation:  describe  technique  for 
inspection  and  defect  analysis 

-  part  examined  under  black  light  for  crack 
indications,  bore  and  surface  of  bolt  holes 

-  indications  measured  using  vernier  calipers 

LPI  Inspection  Report  Form 

Date:  Oct  1990  Operator:  Laboratory  IV 

Part  description:  AGARD  disks  and  spacers 

LPI  system  model  number,  name: 

-  Quality  NDE  Systems  Ltd. 

Standard  procedure: 

MIL  STD  6866:  type  I,  method  D,  sensitivity  level  3 

Inspection  procedure  -  describe  following: 

a.  precleaning 

-  acetone,  then  water  rinse 

b.  penetrant  information 

-  Magnaflux  ZL30 

-  20  min  dwell  time 

c.  penetrant  removal 

-  water  rinse,  followed  by  hydrophilic  emulsifier 
(Magnaflux  ZR10B)  for  60  seconds 

d. drying  temperature  and  time 

-  60C  for  <30  minutes,  until  part  is  dry 

e.  developer  information  and  time 

-  dry  powder  ZPQ 
-10  min  dwell  time 

f.  inspection  method 

-  inspection  under  black  light 

-  measurement  using  vernier  calipers 

g.  post-cleaning 

-  blown  clean 

Defect  evaluation:  describe  technique  for 
inspection  and  defect  analysis 

-  part  examined  under  black  light  for  crack 
indications,  bore  and  surface  of  bolt  holes 

-  indications  measured  using  vernier  calipers 
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MPI  Inspection  Report  Form 
Date:  Feb  1991  Operator:  Laboratory  I 
Part  Description:  AGARD  disks  and  spacers 
MPI  system  model  number,  name: 

Standard  procedure: 

MIL  STD  1949A 

Inspection  procedure  -  describe  following: 

a.  precieaning 

b.  magnetic  suspension  information 

c.  magnetic  current 

d.  demagnetization 

e.  post-cieaning 

Sketch  inspection  geometry: 


MPI  Inspection  Report  Form 

Date:  Mar  1991  Operator:  Laboratory  II 

Part  Description:  AGARD  disks  and  spacers 

MPi  system  model  number,  name: 

-  Magnaflux  H720 

Standard  procedure: 

MIL  STD  1949 A 

Inspection  procedure  -  describe  following: 

a.  precleaning 

b.  magnetic  suspension  information 

c.  magnetic  current 

d.  demagnetization 

e.  post-cieaning 


MPI  Inspection  Report  Form 

Date:  Jan  1992  Operator:  Laboratory  III 

Part  Description:  AGARD  disks  and  spacers 

MPI  system  model  number,  name: 

-  C.G.M.  Censa  FUS  500 

Standard  procedure: 

MIL  STD  1949A 

Inspection  procedure  -  describe  foilowing: 

a.  precleaning 

b.  magnetic  suspension  information 

-  Magnaflux  14A  dispersed  in  liquid  RX/RG  Carrier  II 

c.  magnetic  current 

-20kA 

d.  demagnetization 


e.  post-cieaning 


Sketch  inspection  geometry: 


ECl  Inspection  Report  Form 
Date:  Jan  1991  Operator:  Laboratory  I 
Part  Description:  AGARD  disks  and  spacers 
Material: 

-  AM355  martensitic  stainless  steel 
Surface  finish:  precipitation  hardened 

Test  Instrument: 

-  Magnaflux  ED-520,  serial  number  6635  167  9826 

Instrument  settings 
frequency:  scan  speed: 

gain:  phase: 

filtering: 

Probe  geometry,  type: 

-  Magnaflux  bolt  hole  probe  (1/4"-5/16")  serial 
number  6635  00  018  5836 

-  modified  for  hole  diameter  0. 193" 

Describe,sketch  scan  plan: 


Sketch  Inspection  geometry: 


Describe  technique  for  analysis  of  signai: 
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ECl  Inspection  Report  Form 

Date:  Jan  1992  Operator:  Laboratory  III 

Part  Description:  AGARD  disks  and  spacers 

Material: 

-  AM355  martensitic  stainless  steel 
Surface  finish:  precipitation  hardened 

Test  Instrument: 

-ELOTESTB1.3 

Instrument  settings 

frequency:  500  kHz  scan  speed:  3000  rpm 
gain:  46  dB  phase:  313  degrees 

filtering:  highpass  300  Hz 

Probe  geometry,  type: 

-  ELOTEST  4.4  mm  diameter  rotating  differential 
probe 

Describe, sketch  scan  plan: 

-  probe  hand  held,  inserted  into  bolt  hole 


Describe  technique  for  analysis  of  signal: 


ECl  Inspection  Report  Form 

Date:  Sept  1992  Operator:  Laboratory  V 

Part  Description:  AGARD  disks  and  spacers 

Material: 

-  AM355  martensitic  stainless  steel 
Surface  finish:  precipitation  hardened 

Test  Instrument: 

-  Rohmann  Rototest 

Instrument  settings 
frequency:  500  kHz  scan  speed: 

gain:  31dB  phase: 

filtering: 

Probe  geometry,  type: 

-  Rohmann  rotating  differential  probe 
-4.8  mm  diameter 

-rotor  91. 2.049 

Describe,sketch  scan  plan: 


ECl  Inspection  Report  Form 

Date:  Oct  1990  Operator:  Laboratory  IV 

Part  Description:  AGARD  disks  and  spacers 

Material: 

-  AM355  martensitic  stainless  steel 
Surface  finish:  precipitation  hardened 

Test  Instrument: 

-  ELOTEST  B1. 3 

Instrument  settings 

frequency:  660  kHz  scan  speed:  3000  rpm 
gain:  35  dB  phase:  191  degrees 

filtering:  bandpass  centred  at  500  Hz 

Probe  geometry,  type: 

-  ELOTEST  4.7  mm  diameter  rotating  differential 
probe 

Describe,sketch  scan  plan: 

-  probe  hand  held,  inserted  into  bolt  hole 

Describe  technique  for  analysis  of  signal: 

-  crack  signal  characterised  by  large  amplitude 
signal  at  about  45  deg  phase  from  liftoff  signal 


ECl  Inspection  Report  Form 
Date:  Operator:  Laboratory  VI 

Part  Description:  AGARD  disks  and  spacers 
Material: 

-  AM355  martensitic  stainless  steel 
Surface  finish:  precipitation  hardened 

Test  Instrument: 

-  Rohmann  Rototest 

Instrument  settings 
frequency:  500  kHz  scan  speed: 

gain:  20dB  phase: 

filtering: 

Probe  geometry,  type: 

-  Rohmann  rotating  differential  probe 


Describe,sketch  scan  plan: 


Describe  technique  for  analysis  of  signal: 


Describe  technique  for  analysis  of  signal: 


ECl  Inspection  Report  Form 

Date:  Oct  1990  Operator:  Laboratory  IV 

Part  Description:  AGARD  disks  and  spacers 

Material: 

-  AM355  martensitic  stainless  steel 
Surface  finish:  precipitation  hardened 

Test  Instrument: 

-  ARIES  automated  eddy  current  system,  using 
ELOTESTB1.3 

Instrument  settings 

frequency:  660  kHz  scan  speed:  3000  rpm 
gain:  26  dB  phase:  191  degrees 

filtering:  bandpass  centred  at  500  Hz 

Probe  geometry,  type: 

-  ELOTEST  4.7  mm  diameter  rotating  differential 
probe 

Describe, sketch  scan  plan: 

-  probe  positioned  automatically 

-  tested  at  six  vertical  positions,  centred  vertically  in 
bolt  hole,  1  mm  apart 

-  records  taken  while  probe  stationary 
Describe  technique  for  analysis  of  signal: 

-  crack  signal  charaterised  by  large  amplitude 
sinusoidal  signal  at  about  500  Hz 

eddy  current  crack  signal 


Appendix  B 


Inspection  Data 


Abbreviations  in  Appendix  B 
Technique: 

LPI  liquid  penetrant  inspection 

MPI  magnetic  particle  inspection 

ECI-M  eddy  current  inspection-manual 

ECI-A  eddy  current  inspection-automatic 

ECI-AP  eddy  current  inspection-automatic  with  pattern  recognition 

OMI  optical  microscope  inspection 

XRJ  X-ray  inspection 

ULI  ultrasonic  leaky  wave  inspection 

DI  destructive  inspection 

Result: 

C  indicates  crack  found  in  destructive  inspection 
H  crack  found  or  "hit"  in  inspection 
M  crack  missed 
F  false  call 

Position: 

th  through  crack 

c  comer  crack 

m  middle  crack 
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